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Abstract 

We study optimization problems that are neither approximable in polynomial time (at least with 
a constant factor) nor fixed parameter tractable, under widely believed complexity assumptions. 
Specifically, we focus on MAXIMUM INDEPENDENT Set, Vertex Coloring, Set Cover, and 
Bandwidth. 

In recent years, many researchers design exact exponential-time algorithms for these and other 
hard problems. The goal is getting the time complexity still of order 0(c"), but with the constant 
c as small as possible. In this work we extend this line of research and we investigate whether the 
constant c can be made even smaller when one allows constant factor approximation. In fact, we 
describe a kind of approximation schemes — trade-offs between approximation factor and the time 
complexity. 

We study two natural approaches. The first approach consists of designing a backtracking al- 
gorithm with a small search tree. We present one result of that kind: a (4r — l)-approximation of 
Bandwidth in time 0*(2"/''), for any positive integer r. 

The second approach uses general transformations from exponential-time exact algorithms to 
approximations that are faster but still exponential-time. For example, we show that for any re- 
duction rate r, one can transform any 0*(c")-time' algorithm for Set Cover into a (1 + Inr)- 
approximation algorithm running in time 0*(c"/''). We believe that results of that kind extend the 
applicability of exact algorithms for NP-hard problems. 

Classification: Algorithms and data structures; "fast" exponential-time algorithms 

1 Introduction 

Motivation One way of coping with NP-hardness is polynomial-time approximation, i.e. looking for 
solutions that are relatively close to optimal. Unfortunately it turns out that there are still many problems 
which do not allow for good approximation. Let us recall some examples. Hastad [16] showed that 
Independent Set cannot be approximated in polynomial time with factor n^~"^ for any e > unless 
NP = ZPP. The same holds for Vertex Coloring due to Feige and Kihan [11]. By another result 
of Feige [8], Set Cover cannot be approximated in polynomial time with factor (1 — e) In n, where n 
is the size of the set to cover, for any e > unless NP C DTIME(n^°g'°s"). 

Another approach is the area of parametrized complexity (see e.g. [7]). Then the goal is to find 
an algorithm with time exponential only in a parameter unrelated to the instance size (then we say 
the problem is fixed parameter tractable, FPT in short). This parameter may reflect complexity of the 
instance - like treewidth, but then we get an efficient algorithm only for some subclass of possible 
instances. Another choice of the parameter is the measure of the solution quality. For example, one can 
verify whether in an n-vertex graph there is a vertex cover of size k in 0(1.2738'^ + kn) time [4]. Again, 
the parametrized approach does not succeed in some cases. Verifying whether a graph is fc-colorable is 
NP-complete for any /c > 3, while Independent Set and Set Cover are W[l]- and [2] -complete 
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respectively, meaning roughly that an FPT algorithm for INDEPENDENT SET or SET COVER would 
imply algorithms of that kind for a host of other hard problems. 

The aforementioned hardness results motivate the study of "moderately exponential time" algo- 
rithms. The goal here is to devise algorithms with exponential running time 0(2'^/'') with r big enough. 
Indeed, a 0(2"/^'^)-time algorithm may appear practical for some range of n, say n < 1000. Despite 
some progress in this area we are still far from exact algorithms with time complexity of that order. 
One of the most researched problems in this field is Independent Set. Exhaustive search for that 
problem gives 0(2") time bound while the currently best published result [13] is 0(2"/^ *^''). For Ver- 
tex Coloring the first 0*(2"/°-^^)-time algorithm by Lawler was then improved in a series of papers 
culminating in a breakthrough 0*(2"^) bound of Bjorklund, Husfeldt and Koivisto [2]. 

Now consider the Unweighted Set Cover problem. The instance consists of a family of sets 
8 = {Si, . . . , Sm}- The set ^7 = (J S is called the universe and we denote n = \U\. The goal is to 
find the smallest possible subfamily C C § such that |J C = C/. Assume that m is relatively small but 
big enough that finding an optimal solution using an exact algorithm is out of question, say m = 150. 
If the universe is small we can get a good approximation by the greedy algorithm (see e.g. [23]) with 
approximation ratio < Inn + 1. However this approximation guarantee becomes bad when n is 
big. A natural thing to consider is an approximation algorithm with better (e.g. constant) guarantee and 
with running time exponential but substantially lower than the best known exact algorithm. In this paper 
we explore such approach. Ideally, one would like to have a kind of trade-off between the running-time 
and approximation ratio - then one gets as much accuracy as can be afforded. We study two approaches 
yielding results of that kind. 

Search Tree Techniques Many exponential-time algorithms (e.g. backtracking algorithms) can be 
viewed as visiting the nodes of an exponential sized search tree. The nodes of the tree correspond 
to instances of the problem, and typically the instances in the leaves are either trivial or at least solvable 
in polynomial-time. 

A natural idea is to use a search tree which has fewer nodes than the search tree of the exact algo- 
rithm, and with leaves corresponding to instances that can be approximated in polynomial time. This 
natural approach was used in a work on MAX SAT by Dantsin, Gavrilovich, Hirsch and Konev [6]. 

In this paper we describe one result of that kind: a (4r — l)-approximation of BANDWIDTH in time 
O* (2"/^), for any positive integer r (see Section 2 for the definition of the problem and a brief discussion 
of known results). 

This approach can be used also for Independent Set and Set Cover. For example, Indepen- 
dent Set has constant ratio approximation for graphs of bounded degree. A standard approach to exact 
algorithm for this problem (used e.g. in [13]) is a recursive algorithm, which picks a vertex v and checks 
two possibiUties: (1) t; is in the independent set - then removes v and its neighbors and makes a recur- 
sive call, and (2) ti is not in the independent set - then removes v and makes a recursive call. When we 
can assume that the vertex picked is of large degree (if there is no such vertex polynomial-time approx- 
imation is used) we always get a big reduction of the instance size in one of the recursive calls which 
results in a better time bound than the exact algorithm. However, we will not elaborate on this because 
we obtained much better results (also for Set Cover) using the approach of reduction (see the next 
paragraph). 

Reductions Consider an instance S = {Si, ... , Sm} of the Unweighted Set Cover problem de- 
scribed above. Assume m is even. Then create a new instance Z = {Zi,. . . , where Zi = 
S2i-i U S2i. Next find an optimal solution OPT^, for 2, using an exact algorithm. Let C = {S2i-i | Z^ G 
OPT:^} U {S2i I Zi G OPT^}. Clearly, |OPTz| < |OPTs| and hence |e| < 2|0PT§|. Thus we 
get a 2-approximation in T{m/2) time where T(m) is the best known bound for an exact algorithm, 
so currently just T(m/2) = 0*(2"*/^) after applying the exhaustive search. Of course this method is 
scalable - similarly we get a 5-approximation in time 0*(2"*/^). With the present computing speed it 
should allow to process instances with roughly 150 sets, even when the universe U is large. 

The above phenomenon is the second of the two approaches studied this paper. We will call it a 
reduction. Let us state a more precise definition now (however, we will make it a bit more general 
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further in the paper). Consider a minimization problem P (reduction of a maximization problem is 
defined analogously) with a measure of instance size s{I), and a measure of the solution quality m{S). 
Let OPT/ be an optimal solution for instance /. 

Let r,a > 1 be constants. A (r, a)-reduction (or simply a reduction) of problem P is a pair of 
algorithms called reducer and merger satisfying the following properties: 

• Reducer transforms /, an instance of P, into a set {/i, ■.■■,1k} of instances of P so that for every 
i = l,...,fe,s(Ii) <s(/)/r + 0(l). 

• Let 5i, . . . , 5fc be optimal solutions of instances /i, . . . , 7^. Then Merger transforms the solutions 
Si into S, a solution for instance I, so that m{S) < a ■ OPT/. (Merger may also use I and any 
information computed by reducer). 

The constants r and a in the above definition will be called the rate and the approximation of the 
reduction, respectively (we assume a > 1, even for a maximization problem - then a solution with 
quality > OPT//a is returned). Observe that above we described a (2, 2)-reduction of UNWEIGHTED 
Set Cover. Actually, we noted that it generalizes to (r, r)-reduction for any r G N. If there is a 
(r, a(r))-reduction for r being arbitrarily big we talk about reduction scheme and the function a(r) is 
the approximation of this scheme. (This definition is very flexible, however, most of our schemes imply 
a reduction for any r G N, and sometimes even for any r G Q). 



Problem 


Approximation 


Range of r 


Current time bound 


Unweighted Set Cover 


1 + Inr 


r G Q, r > 1 


0*(2"/''), [2] 


Set Cover 


1 + Inr 


r G Q, r > 1 


C'*(2"/(0-3i^)), App. E 


Set Cover 


r 


r G N,r > 1 


0*(2"^/'-), [folklore] 


MiN Dominating Set 


r 


r G N,r > 1 


O* (20-598"/^), [21] 


Max Independent Set 


r 


r G Q,r > 1 


0*(2"/(3-47r))^ [13] 


Coloring'' 


1 + Inr 


r G Qn [1,4.05] 


(3*(-2n/(0.85r)^ [2] 


Coloring^ 


1 + 0.247rlnr 


r G Q,r > 4.05 


Q*(-2n/(0.85r)^ [2] 


Coloring 


r 


r G N,r > 1 


Q*(-2n/(0.85r)^ [2] 


Bandwidth 


j,log2 9 _ gfe 


r = 2^=,^; G N 


O*(10'*/''), [10] 


Semi-Metric TSP 


1 + log2 r = l + k 


r = 2*^,^ G N 


Q*^2"/(0-5r))^ [1] 



"This is an 0*(2"/^-*'')-time reduction by Bjorklund and Husfeldt, see [2] 
'This is an 0*(2"/(°-^^'-')-time reduction. 



Table 1: Our reductions. Last column shows time bounds of approximation algorithms obtained using 
the best known (polynomial space) exact algorithms. 

We present reduction schemes for several most natural optimization problems that are both hard to 
approximate and resist FPT algorithms. Table 1 shows our results. In last column we put time bounds of 
approximation algorithms obtained by using our reductions with best known exact algorithms. As our 
motivations are partially practical, all these bounds refer to polynomial space exact algorithms (putting 
r = 1 gives the time complexity of the relevant exact algorithm). In most cases (Bandwidth, Col- 
oring, Independent Set, Semi-Metric TSP) there are faster exact exponential-space algorithms 
(hence we would get also faster approximations). 

Note that by putting r = n/logn we get polynomial time approximations, and for Set Cover 
we get the approximation ratio 1 + In n, which roughly matches the ratio of the (essentially optimal) 
greedy algorithm. Thus, our reduction can be viewed as a continuous scaling between the best possible 
polynomial time approximation and the best known exponential time algorithm. In other words, one can 
get as good solution as he can afford, by using as much time as he can. A similar phenomenon appears 
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in the case of Semi-Metric TSP. (This is not very surprising since these two reductions are based on 
the relevant polynomial time approximations). 

The notion of reduction introduced in our paper is so natural that some reductions must have been 
considered before, especially for big reduction rates, like r = n/ log n, when the reductions essentially 
imply polynomial-time approximation algorithms. We are aware of one reduction described in the con- 
text of exponential-time approximation: Bjorklund and Husfeldt [2] described a reduction scheme with 
approximation a(r) = (1 + Inr) (worth using only for bounded values of r - see §C). 

Related Work We have already mentioned results of Bjorklund and Husfeldt [2] and Dantsin et 
al. [6] on exponential-time approximation. The idea of joining the worlds of approximation algorithms 
and "moderately" exponential algorithms appeared also in a recent work of Vassilevska, WilUams and 
Woo [22], however their direction of research is completely different from ours, i.e. they consider so- 
called hybrid algorithms. For example, they report to have an algorithm for BANDWIDTH which for 
given input either returns an 0(logn)-approximate solution in polynomial time or returns a (1 + e)- 
approximate solution in 0(2"/^°^'°^") time. We see that the hybrid algorithm does not guarantee con- 
stant approximation ratio and hence cannot be directly compared with our work. 

Another promising area is joining the worlds of parametrized complexity and polynomial-time ap- 
proximation algorithms — see the survey paper [19]. 

Organization of the Paper We start from the approximation scheme for the Bandwidth problem 
in Section 2. Then in Section 3 we introduce slightly more general definition of reduction and then 
in Section 4 describe two reductions for Set Cover. (The reductions for Maximum Independent 
Set, Vertex Coloring, Bandwidth and Semi-Metric TSP are put in Appendix due to space 
limitations.) We conclude in Section 5 by some complexity remarks that show relations between the 
notion of reduction and polynomial-time approximation. 

2 Bandwidth 

Let G = {V, E) be an undirected graph. For a given ordering of vertices, i.e. a one-to-one function 
/ : V {!,••• ,?^}, its bandwidth is the maximum difference between the numbers assigned to the 
endpoints of an edge, i.e. max^^ge \ f{u) — f{v)\. Bandwidth of graph G, denoted by bw(G), is the 
minimum possible bandwidth of an ordering. The BANDWIDTH problem asks to find, for a given graph, 
its bandwidth with the corresponding ordering. 

Bandwidth is a notorious NP-hard problem. It was shown by linger [20] that Bandwidth does 
not belong to APX even in very restricted case when G is a caterpillar, i.e. a very simple tree. It is 
also hard for any fixed level of the W hierarchy [3]. The best known polynomial-time approximation, 
due to Feige [9], has 0(log'^ nVlog n log log n) approximation guarantee. The fastest known exact 
algorithm works in time 0*(5") and space 0*(2") and it is due to Cygan and Pilipczuk [5], while the 
best polynomial-space exact algorithm, due to Feige and ICiUan [10], has time complexity O*(10"). 

We were able to find a reduction for the Bandwidth problem. Although it is probably the most 
nontrivial of our reductions, it gives, for any G N, approximation ratio 9*^ with reduction rate 2^, which 
is far from being practical (see Appendix D for the details). As a corollary it gives a 9'^-approximation in 
time O*(10"'/^ ) and polynomial space, or in time 0*(5"/^ ) and 0*(2"/^ ) space. It is an interesting 
open problem whether there is a better reduction for this problem. 

Now we will describe a better approximation scheme using the approach of small search tree. 

2.1 2-approximatioii in (9*(3")-time (warm-up) 

We begin with an algorithm which is very close to a fragment of the O*(10")-time exact algorithm of 
Feige and Kilian [10]. Assume w.l.o.g. the input graph is connected (we keep this assumption also in 
the following sections). 
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Let b be the bandwidth of the input graph — we may assume it is given, otherwise with just a 
O(logn) overhead using binary search one can find the smallest b for which the algorithm returns a 
solution. 

Let us partition the set of positions {1, . . . , n} into intervals of size b (except, possibly, for the 

last interval), so that for j = 0, . . . , \n/b] — 1, the j-th interval consists of positions Ij = {jb + l,jb + 
2,...,{j + l)b}n{l,...,n}. 

Pseudocode 2.1 Generating at most nS'^ assignments in the 2-approximation algorithm. 
1: procedure GenerateAssignments(^) 
2: if all nodes in are assigned then 

3: If each interval Ij is assigned \Ij | vertices, order the vertices in intervals arbitrarily and return 

the ordering. 
4: else 

5: V <— a vertex with a neighbor w already assigned. 

6: if A{w) > then GenerateAssignments(A U {{v, A{w) - 1)}) 

7: GeNERATEASSIGNMENTS(^ U {{v, A{w))}) 

8: if A{w) < \n/b] - 1 then GenerateAssignments(^ U {{v, A{w) + 1)}) 



9: procedure Main 
10: for j ^ to {n/b] - 1 do 
11: GENERATEASSIGNMENTS ({{r,j)}) 



> Generate all assignments with r in interval Ij 



The algorithm finds a set of assignments of vertices into intervals Ij such that if there is an ordering tt 
of bandwidth at most b, for at least one of these assignments, for every vertex v, Tr{v) hes in the assigned 
interval. Clearly, if there is an ordering of bandwidth b, at least one such assignment exists. The follow- 
ing method (introduced by Feige and Kilian originally for intervals of length 6/2) finds the required set 
with only at most n3" assignments. Choose an interval for the first vertex r (chosen arbitrarily) in all 
\n/b] ways. Then pick vertices one by one, each time taking a vertex adjacent to an already assigned 
one. Then there are at most 3 intervals where the new vertex can be put and so on. (See Pseudocode 2.2. 
(Partial) assignment is represented by a set of pairs; a pair {v, j) means that A{v) = Ij.) 

Obviously, when there are more vertices assigned to an interval than its length, the assignment is 
skipped. Now it is clear that for any remaining assignment any ordering of the vertices inside intervals 
gives an ordering of bandwidth at most 26. Hence we have a 3-approximation in 0*(3")-time and 
polynomial space. 

Note also that if we use intervals of length 6/2 as in Feige and Kilian's algorithm, similar method 
gives 3/2-approximation in 0*(5'^)-time. 

2.2 Introducing the Framework 

We are going to extend the idea from the preceding section further. To this end we need generaUzed 
versions of simple tools used in the 2-approximation above. 

Let a (partial) interval assignment be any (partial) function A : V ^ 2^^' - '"^, that assigns intervals 
of positions to vertices of the input graph. An interval {i,i + I, . . . ,j} will be denoted The size 
of an interval is simply the number of its elements. Let tt : V ^ {1, . . . , n} be an ordering. When for 
every vertex v, 7r{v) G A{v), we will say that an interval assignment A is consistent with tt and tt is 
consistent with A. 

In Section 2.1 all intervals had the same size 6, moreover two intervals were always either equal or 
disjoint. When this latter condition holds, it is trivial to verify whether there is an assignment consistent a 

given interval assignment — it suffices to check whether the number of vertices assigned to any interval 
does not exceed its size. Luckily, in a general case it is still possible in polynomial time: just note that 
this is a special case of scheduhng jobs on a single machine with release and deadline times specified 
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for each job (see e.g. [18], Sec. 4.2) — hence we can use the simple greedy algorithm which processes 
vertices in the order of max A{v) and assigns each vertex to the smallest available position. 

Proposition 2.1. For any interval assignment A one can verify in 0(n log n) time whether there is an 
ordering consistent with A. 

To get a nice approximation ratio, however, we need a bound on the bandwidth of resulting ordering. 
The obvious bound is 

max max \i — j\. 

UV£E ieA(u), 

jeA(v) 

The above bound was sufficient in Section 2. 1, but we will need a better bound. 

Lemma 2.2. Let A be an interval assignment for an input graph G = iV, E). Let s be the size of the 
largest interval in A, i.e. s = max^gy 1^(^)1- If there is an ordering ir* of bandwidth b consistent with 
A, then one can find in polynomial time an ordering tt that is consistent with A and has bandwidth at 
most s + b. 

Proof. Consider any edge uv. Clearly, 7r*(n) G [minA(t!) — b,max.A{v) + b]. Hence we can replace 
A{u) by A{u) n [min^(7;) — b, maxA{v) + b], maintaining the invariant that tt* is consistent with A. 
Similarly, we can replace A{v) by A{v) fl [min A{u) — b, max A{u) + b]. Our algorithm performs such 
replacements for every edge uv e E. Asa result we get an assignment A' such that for every edge uv, 
^^ieA'{u),jeA'{v) K ~ il ^ s + 6. It is clear that any ordering consistent with A' has bandwidth at most 
s + b. Such the ordering can be found in polynomial time by Proposition 2. 1 □ 

In the following sections it will be convenient to formalize a little the order in which intervals are 
assigned to the vertices of the input graph. Recall that each time an interval is assigned to a new vertex 
V, V has an already assigned neighbor w, except for the initial vertex r. In other words, the algorithm 
builds a rooted spanning tree for each assignment (here, r is the root, and w is the parent ofv). In what 
follows, we will fix a rooted spanning tree T, and our algorithm will generate interval assignments in 
such a way that the first vertex assigned r is the root of T, and whenever a vertex v ^ r is assigned, its 
parent in T has been already assigned. 

2.3 3-approximation in O* (2'')-time 

This time, the algorithm uses \n/b] intervals, each of size 25 (except for one or two last intervals), so 
that for j = 0, . . . , \n/b] — 1, the j-th interval consists of positions Ij = {jb + l,jb+2, . . . , (_7 + 2)6}n 
{1, . . . , n}. Note that the intervals overlap. 

Pseudocode 2.2 Generating at most n2" assignments in the 3-approximation algorithm. 
1: procedure GenerateAssignments(74) 
2: if all nodes in T are assigned then 

3: Using Lemma 2.2 find ordering consistent with interval assignment corresponding to A. 

4: else 

5: f a node in T such that v's parent w is assigned. 

6: if A{w) > then GenerateAssignments(^ U {{v, A{w) - 1)}) 

7: iSA{w) < \n/b] - 1 then GenerateAssignments(74 U {{v,A{w) + 1)}) 



8: procedure Main 
9: for j ^ Oto [n/61 - Ido 
10: GENERATEASSIGNMENTS ({(r, j)}) 



> Generate all assignments with root in Ij 



The algorithm generates all possible assignments of vertices to intervals in such a way that if a node 
in T is assigned to interval Ij then each of its children is assigned to interval or /j+i- Clearly, there 
are at most n2" such assignments. Moreover, if there is an ordering tt of bandwidth 6, then the algorithm 
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generates an interval assignment consistent with tt. To find A^,-, visit the nodes of T in preorder, 
assign the root r to the interval ^'^(^^(r)-!)/,] , and for each node v with parent w already assigned to an 
interval Ij, put At^{v) = Ij^i if tt{v) > (j + 1)6 and At^{v) = otherwise. For each generated 
assignment the algorithm tries to find an ordering of bandwidth at most 36 using Lemma 2.2. Clearly, it 
succeeds for at least one assignment, namely At^. The algorithm is sketched in Pseudocode 2.2. 

2.4 (4r — 1) -approximation in 0*(2"/'^)-time 

In this section we are going to generalize the algorithm from the prior section to an approximation 
scheme. Let r be a positive integer. We will describe a (4r — 1) -approximation algorithm. Our algorithm 
uses intervals of sizes 2ib, for r < i < 2r — 1. Note that unlike in previous algorithms, intervals of many 
different sizes are used. As before, intervals will begin in positions jb + 1, for j = 0, . . . , [n/6] — 1. 
The interval beginning in jb + 1 and of length 2ib will be denoted by Ij^2i- For convenience, we allow 
intervals not completely contained in {1, ... , n}, but each assigned interval contains at least one position 
from {1, . . . ,n}. 

Pseudocode 2.3 Generating assignments in the (4r — l)-approximation algorithm. 



1: procedure GenerateAssignments(^) 

2: if all nodes in T are assigned then 

3: Cut all intervals in A to make them contained in {1, . . . , n}. 

4: Using Lemma 2.2 find ordering consistent with interval assignment corresponding to A. 

5: else 

6: <— a node in T such that v's parent w is assigned; let Ij^2i = A{w). 

7: if z + 1 < 2r - 1 then 

8: GENERATEASSIGNMENTS(A U {{v, Ij_i 2(i+i)}) 

9: else 

10: if j - 1 + 2r > 1 then GenerateAssignments(A U {{v, /j_i,2r}) 

11: if j - 1 + 2r < [n/6] - 1 then GENERATEASSIGNMENTS(A U {{v, Ij-i+2r,2r}) 

12: procedure MAiN(io) 

13: for j ^ Oto [n/6] - 1 do 

14: GenerateAssignments ({(/■, /y,2;„)}) > Generate all assignments with root in /y.2i, 



The algorithm is sketched in Pseudocode 2.3. Let io G {r, . . . , 2r — 1} be a parameter that we will 
determine later. The algorithm assigns the root of T to all possible intervals of size 2zo6 that overlap 
with {1, . . . , n} and extends each of these partial assignments recursively. 



To extend a given assignment, the algorithm chooses a node u of T such that the parent w of v has 
been already assigned an interval, say 2i- Consider the interval /j-i,2(j+i) which is obtained from 
Ij,2i by "extending" it by 6 positions both at left and right side. Note that in any ordering consistent with 
the current assignment, v is put in a position from 2(i+i)- Hence, if 2(i+i) is not too big, i.e. 
i + 1 < 2r — 1, the algorithm simply assigns Ij^i^2{i+i) ^ v and proceeds with no branching (just one 
recursive call). Otherwise, if i + 1 = 2r, the interval /j-i,2(t+i) is split into two intervals of size 2r, 
namely Ij-i,2r and /j_i_|_2r,2r and two recursive calls follow: with v assigned to Ij-i,2r and Ij-i^2r,2r 
respectively. 

As before, for every generated assignment (after cutting the intervals to make them contained in 
{1, . . . ,n}) the algorithm applies Lemma 2.2 to verify whether it is consistent with an ordering of 
bandwidth [2(2r — 1) + 1]6 = (4r — 1)6. Similarly as in the case r = 1 described before, for at least 
one assignment such the ordering is found. 

We conclude with the time complexity analysis. Observe that the nodes at tree distance d from the 
root are assigned intervals of size 2[(io + d) mod r + r]. It follows that branching appears only when 
i() + d = (mod r). Let n{io) denote the number of nodes at tree distance d satisfying this condition. 
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It is clear that the above algorithm works in time O*(2"('o)). Since X^jg^^ 2r-i} ^(^) ~ some 
i E {r, . . . ,2r — 1}, fi{i) < n/r. By choosing this value as io, we get the 0*(2"/'') time bound. 

Theorem 2.3. For any positive integer r, there is a (4r — 1) -approximation algorithm for BANDWIDTH 
running in 0*(2"/^) time and polynomial space. □ 

3 Reducibility (slightly more general) 

In this section we introduce a slightly more general version of reduction and discuss some of its basic 
properties. Essentially the difference from the version in the Introduction is that sometimes between 
reducer and merger we want to use approximation algorithm instead of exact one. 

As before let P be a minimization problem, let s(/) and m{S) denote the measures of the instance 
size and the solution quality, respectively. Let r > 1 be a constant and / : M M a function. An (r, /)- 
reduction (or simply a reduction) of P is a pair of algorithms called reducer and merger satisfying the 
following properties: 

• Reducer transforms /, an instance of P, into a set {Ji, 7^} of instances of P so that for every 
j = l,...,k,s{Ij)<s{I)/r + 0{l). 

• Let Si,. . . Sk be solutions of instances 7i, . . . , 7^. Let a > 1 be an approximation guarantee 
of these solutions, i.e. for j = 1, . . . , k, m{Sj) < am(OPT/^). Then merger transforms the 
solutions Si into S, a solution for instance 7, so that m{S) < /(a) OPT/. (Merger may also use 
7 and any information computed by reducer). 

As before, r is called the rate and / is called the approximation (since we do not expect / to be a constant 
function it should not lead to ambiguity). Again, if there is a (r, /,.) -reduction for arbitrarily big r we deal 
with reduction scheme with approximation a(r, a) = fr{c(). Note that the already described reduction 
for Unweighted Set Cover has approximation a(r, a) = ra. 

The time complexity of the reduction is the sum of (worst-case) time complexities of reducer and 
merger. In most cases our reductions will be polynomial time. However, under some restrictions 
exponential-time reductions may be interesting as well. 

The following lemma will be useful (an easy proof is in Appendix A): 

Lemma 3.1 (Reduction Composition). If there is an (r, f)-reduction R then for any positive k there 
is a {r^, f^)-reduction^ R' for the same problem. Moreover, if the merger of R generates a polynomial 
number of instances then R' has the same time complexity as R, up to a polynomial factor 

Note that the Reduction Composition Lemma implies that once we find a single (r, /)-reduction, it 
extends to a reduction scheme, though for quite hmited choice of r. We will see more consequences of 
this lemma in Section 5. 

4 Set Cover 

We will use the notation for Set Cover from the Introduction. Since here we consider the general, 
weighted version of the problem, now each set 5 G S comes with its weight w{S). We will also write 
w{Q) for the total weight of a family of sets C. In the case of Set Cover there are two natural measures 
for size of the instance: the size of the universe U and the number of sets in the family §. We will present 
reductions for both measures. Both reductions work for the weighted version of the problem. 

V is the composition: = / o f-\ f = id. 
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4.1 Reducing the size of universe 

An r-approximate solution of Set Cover can be found by dividing U into r parts, covering each of 
them separately and returning the union of these covers. It corresponds to a reduction scheme with 
approximation a(r, a) = ra for r G N. However, we will describe a much better reduction scheme. 

Let's recall the greedy algorithm (see e.g. [23]), called Greedy from now. It selects sets to the cover 
one by one. Let C be the family of sets chosen so far. Then Greedy takes a set that covers new elements 
as cheap as possible, i.e. chooses S so as to minimize w{S) /\S\\JC\. For each element e G 5 \ IJ C the 
amount w{S)/\S\ [J C| is called the price of e and denoted as price(e). This procedure continues until 
Q covers the whole U. Let ei, . . . , be the sequence of all elements of U in the order of covering by 
Greedy (ties broken arbitrarily). The standard analysis of Greedy uses the following lemma (see [23] 
for the proof). 

Lemma 4.1. For each k £ 1, . . . , n, price(efc) < w(OPT) /{n — k + I) 

The idea of our reduction is very simple. For example, assume we aim at a reduction rate 2, and 
n is even. Lemma 4.1 tells us that Greedy starts from covering elements very cheaply, and than pays 
more and more. So we just stop it before it pays much but after it covers sufficiently many elements. 
Note that if we manage to stop it just after e„/2 is covered the total price of the covered elements (and 
hence the weight of the sets chosen) is at most (F„ - Hn/2)w{0FT) = (In 2 + 0(l/n))u;(OPT). If 
we cover the remaining elements, say, by exact algorithm we get roughly a (1 + ln2)-approximation. 
However the set that covers e„/2 may cover many elements ei, i > n/2. By Lemma 4.1 the price of 
each of them is at most i(; (OPT) /(n/2) = 2u;(0PT)/n. Hence this last set costs us at most ^i'(OPT) 
and together we get roughly a (2 + In 2)-approximation. Luckily, it turns out that paying ii;(OPT) for 
the last set chosen by Greedy is not necessary: below we show a refined algorithm which would yield 
a (1 + In 2)-approximation in this particular case. 

Theorem 4.2. There is a polynomial-time \U\-scaling reduction scheme for Set Cover with approxi- 
mation a{r, a) = a + Inr + O {l/n),for any r E Q, r > 1. 



Pseudocode 4.1 Universe-scaling reducer for Set Cover 

1: e^0. 

2: while U§uUe = t^do 

3: Find T G S so as to minimize |^y|jg| 

4: ifn- HJeuTl > n/rthen 

5: e ^ e U {T}. 

6: else 

7: Ct ^ e 

8: [Create an instance It = (St, w)'-] 

9: for each P G §, Sr contains set P \ ((J Cr U T), of weight w{P). 

10: S ^ S \ {T} 



Proof. Let / = (§,w) be an instance of Set Cover problem. Reducer works similarly as Greedy. 
However, before adding a set T to the partial cover C it checks whether adding T to C makes the number 
of non-covered elements at most n/r. If so, T is called a crossing set. Instead of adding T to C, reducer 
creates an instance It = (St, w) of Set Cover that will be used to cover the elements covered neither 
by e nor by T. Namely, for each P G S, St contains set P \ (|J C U T), of weight w{P). Apart from 
It reducer stores Ct, a copy of C, which will be used by merger. After creating the instance, set T is 
removed from the family of available sets S. If it turns out that the universe cannot be covered after 
removing T, i.e. |J S U (J C 7^ [/, the reducer stops. See Pseudocode 4.1 for details. Note that reducer 
creates at least 1 and at most |S| instances. 



9 



Let It be any instance created for some crossing set T and let SOLt C S be its solution such that 
u;(SOLr) < aw{OPTj^), a>l. Let = Ct U {T} U SOLy. Clearly, §^ is a cover of U for every 
crossing set T. The merger simply selects the lightest of these covers. 

Let T* be the first crossing set found by reducer such that T* belongs to OPT/, some optimal 
solution for instance / (note that at least one crossing set is in OPT/). Clearly OPT/ \ {T*} covers 
IJSr*- Hence w{OFTj^, ) < u>(OPT/ \ {T*}) so w{T*) + w;(OPT/^.) < u;(OPT/). It follows that 
w{T*) + w{SOLt*) < aw{OPTj). Since St* covers less than n — n/r elements, by Lemma 4.1 

[n-n/rj x n-\n/r~\ x 

k=l k=l 

= (Inn - In [n/r] + O (l/n))u'(OPT/) < (Inr + O (l/n))u;(OPT/). 
We conclude that merger returns a cover of weight < (a + In r + O (^) )'u;(OPT/). □ 

Clearly, to make use of universe-scaling reduction we need a 0*(c") exact algorithm, where c is a 
constant. As far as we know there is no such result published. However we can follow the divide-and- 
conquer approach of Gurevich and Shelah [15] rediscovered recently Bjorklund and Husfeldt [1] and 
we get a 0*(4"m^°s")-time algorithm. If m is big we can use another, 0*(9")-time version of it. See 
Appendix E for details. 

We also note that for the unweighted case there is an 0(2"mn)-time polynomial space algorithm by 
Bjorklund et al. [2] using the inclusion-exclusion principle. 

4.2 Reducing the number of sets 

Recall the reduction described in the introduction. In the weighted version it fails, basically because the 
sets from the optimal solution may be joined with some heavy sets. The natural thing to do is sorting 
the sets according to their weight and joining only neighboring sets. This simple modification does not 
succeed fully but with some more effort we can make it work. 

Theorem 4.3. There is a polynomial-time \§\-scaling reduction scheme for Set Cover with approxi- 
mation a{r, a) = ar, for any r G N, r > 1. 

Proof. Reducer starts from sorting the sets in S in the order of non-decreasing weight. So let § = 
{^i, . . . , Sm} so that w{Si) < w{S2) < • • • < w{Sm)- Next it partitions this sequence into blocks 23j, 
i = 1,... , \m/r], each of size at most r, namely = {Sj e § \ {i — l)r < j < ir}. Let Ui = \J'Bi 
be the union of all sets in !Bj and define its weight as the total weight of Sj, i.e. w{Ui) = w('Bj). For 
any k = 1, . . . , m we also define = {Sj G '^\k/r^ I i < ^} and 14 = |J with w(Vfe) = w{X). 
Reducer creates m instances, namely $i = {Uj \ Si ^ Hj} U {Vi, Si} for i = 1, . . . ,m. 

Of course any subfamily (or a cover) C C Sj corresponds to C, a subfamily of § with the same 
weight obtained from C by splitting the previously joined sets (we will use this denotation further). 
Clearly |J C = U C, in particular if S is a cover, so is S. 

Let Ci, . . . , Cm be solutions (covers) for the instances created by reducer, such that t/;(Si) < ait;(OPT§.). 
Merger simply chooses the lightest of them, say 6^, and returns 6^, a cover of U. 

Now it suffices to show that one of the instances has a cover that is light enough. Let i* = 
max{z 1 Si G OPT}. We focus on instance Sj*. If Xj* H OPT = we choose its cover 51 = 
{Uj G Sj* I "Bj n OPT / 0} U {Si*}, otherwise % = {Uj G Sj* | B^- n OPT / 0} U {Vi*,Si*] 
Clearly it suffices to show that w{% \ OPT) < (r - l)ti;(OPT). Consider any Sj G \ OPT. 
If ^j Xj* we put f{i) = min{j | Sj G OPT and [j/r] > [i/r]}, otherwise f{i) = i* . Then 
w{Si) < w{Sf(^i^). We see that / maps at most r — 1 elements to a single index of a set from 
OPT, so indeed \ OPT) < (r - l)it;(OPT) and hence w{^) < rw{OFT). It follows that 
'u;(OPTs.J < ru;(OPT) so ^(6^*) < arw{OPT) and finally lo(e^) < aru;(OPT). □ 
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4.3 Special Case: (Weighted) Minimum Dominating Set 

Of course, Minimum Dominating Set is a special case of Set Cover - a graph G = (V, E) 
corresponds to the set system § = {N[v\ | v G V}, where N[v\ consists of v and its neighbors. Note the 
set merging algorithm described in Section 4.2 can be adapted here: merging sets corresponds simply 
to identifying vertices. Hence we get a reduction scheme with approximation a(r, a) = ar. Combined 
with the recent 0(2*^-^^^")-time exact algorithm by Rooij and Bodleander we get an r-approximation in 
time O(20-598"/'-), for any natural r. 

5 Reductions and polynomial-time approximation 

Is it possible to improve any of the reductions presented before? Are some of them in some sense opti- 
mal? To address these questions at least partially we explore some connections between reductions and 
polynomial-time approximation. For example note that the (r, ar)-reduction for Max Independent 
Set implies (n/ log n)-approximation in polynomial time, by putting r = n/ log n and using an exact 
algorithm for instances of size O(logn). Since we know that Max Independent Set cannot be ap- 
proximated much better in polynomial time it suggests that this reduction may be close to optimal in 
some sense. The following lemma is an immediate consequence of Reduction Composition Lemma. Let 
us call a reduction bounded when the reducer creates 0(1) instances. 

Lemma 5.1. If for some r > 1 there is a polynomial-time bounded (r, f)-reduction for problem P, then 
P is flo9rn-\og^ ^°^^'^{l)-approximable in polynomial time. 

Corollary 5.2. If for some constants c,r, r > l,c > there is a polynomial-time bounded {r,f)- 
reduction with f{a) = ca -\- o{a) for problem P, then P is 0{j^^)'^°^^'^-approximable in polynomial 
time. 

Note that Corollary 5.2 implies that neither Max Independent Set nor Vertex Coloring has 
a polynomial time bounded (r, qra + o(a))-reduction for any g < 1, unless NP = ZPP. If we skip 
the assumption that the reduction is bounded, the existence of such a reduction implies approximation in 
^0(iog n) {jjjjg^ which is also widely believed to be unlikely. Hence improved reductions need use either 
exponential time or some strange dependence on a, say a{a) = O.la^. 

References 

[1] A. Bjorklund and T. Husfeldt. Exact algorithms for exact satisfiability and number of perfect 
matchings. In Proc. ICALP'06, pages 548-559, 2006. 

[2] A. Bjorklund, T. Husfeldt, and M. Koivisto. Set partitioning via inclusion-exclusion. SIAM J. 
Comput., Special Issue for FOCS 2006. To appear. 

[3] H. L. Bodlaender, M. R. Fellows, and M. T. Hallett. Beyond NP-completeness for problems of 
bounded width: Hardness for the W hierarchy (extended abstract). \n ACM Symposium on Theory 
of Computing, pages 449^58, 1994. 

[4] J. Chen, I. A. Kanj, and G. Xia. Improved parameterized upper bounds for vertex cover. In Proc. 
MFCS'06, pages 238-249, 2006. 

[5] M. Cygan and M. PiUpczuk. Faster exact bandwidth. In Proc. WG'08. To appear. 

[6] E. Dantsin, M. Gavrilovich, E. A. Hirsch, and B. Konev. MAX SAT approximation beyond the 
Umits of polynomial-time approximation. Ann. PureAppl. Logic, 113(l-3):81-94, 2001. 

[7] R. G. Downey and M. R. Fellows. Parameterized Complexity. Springer, 1999. 



11 



[8] U. Feige. A threshold of Inn for approximating set cover. J. ACM, 45(4):634-652, 1998. 

[9] U. Feige. Approximating the bandwidth via volume respecting embeddings. J. Comput. Syst. ScL, 
60(3):510-539, 2000. 

[10] U. Feige. Coping with the NP-hardness of the graph bandwidth problem. In Proc. SWAT' 00, pages 
10-19, 2000. 

[11] U. Feige and J. Kilian. Zero knowledge and the chromatic number J. Comput. Syst. ScL, 
57(2):187-199, 1998. 

[12] U. Feige and M. Singh. Improved approximation ratios for traveling salesperson tours and paths 
in directed graphs. In Proc. APPROX-RANDOM'07, pages 104-118, 2007. 

[13] F. V. Fomin, F. Grandoni, and D. Kratsch. Measure and conquer: a simple 0(2''-^^^") independent 
set algorithm. In Proc. SODA' 06, pages 18-25, 2006. 

[14] A. Frieze, G. Galbiati, and F. Maffioli. On the worst-case performance of some algorithms for the 
asymmetric traveling salesman problem. Networks, 12:23-39, 1982. 

[15] Y. Gurevich and S. Shelah. Expected computation time for hamiltonian path problem. SIAM J. 
Comput., 16(3):486-502, 1987. 

[16] J. Hastad. Clique is hard to approximate within it}~'^. Acta Mathematica, 182(1):105-142, 1999. 

[17] M. Held and R. Karp. A dynamic programming approach to sequencing problems. Journal of 
SIAM, 10:196-210, 1962. 

[18] J. Kleinberg and E. Tardos. Algorithm Design. Addison-Wesley Longman Publishing Co., Inc., 
Boston, MA, USA, 2005. 

[19] D. Marx. Parameterized complexity and approximation algorithms. The Computer Journal, 
51(l):60-78, 2008. 

[20] W. Unger. The complexity of the approximation of the bandwidth problem. In Proc. FOCS'98, 
pages 82-91, 1998. 

[21] J. M. M. van Rooij and H. L. Bodlaender Design by measure and conquer, a faster exact algorithm 
for dominating set. In Proc. STACS'08, pages 657-668, 2008. 

[22] V. Vassilevska, R. Williams, and S. L. M. Woo. Confronting hardness using a hybrid approach. In 

Proc. SODA' 06, pages 1-10, 2006. 

[23] V. V. Vazirani. Approximation Algorithms. Springer, 2001. 



12 



A Proof of the Reduction Composition Lemma 



Lemma A.l (Reduction Composition). If there is a (r, f)-reduction R then for any positive /c € N there 
is a {r^ , f'') -reduction^ R' for the same problem. Moreover, if the merger of R generates a polynomial 
number of instances then R' has the same time complexity as R, up to a polynomial factor 

Proof We use induction on k. Let R and M be the reducer and the merger of R, respectively. We will 
describe R', which consists of the reducer R^ and the merger M^. 

For /c = 1 the claim is trivial. Now assume there is a (r'^"^, /*^~^)-reduction Q with reducer Rk-i 
and merger M^-i. 

Let I be the input instance for reducer R^. R^ executes Rk-i which generates instances /i, . . . , Ig. 
By induction hypothesis, s{Ii) < s{I)lr^~^ for z = 1, . . . , g. Then for each i = 1, . . . ,q, R^ applies R 
to li, which generates instances Ij^i, . . . , Ij g.. Note that for each s{Iij) < s{I)/r^. 

Now assume is a solution for /jj such that 5jj < aOPT/. ^. (for minimization problem)^. 
Merger appUes M to every sequence of solutions . . . , Si^q^ and gets a resulting solution Si for 
every i = 1,. . . ,q. By the definition of reduction m{Si) < /(a)0PT7.. Then apphes -Mfe_i to 
Si, . . . ,Sq, obtaining a solution S. Then, by the induction hypothesis m{S) < /'^~^(/(a))OPT/ and 
hence m{S) < /'^(a)OPT/, as required. 

The second claim follows easily, since R^ generates instances. □ 

B Maximum Independent Set 

Theorem B.l. There is a polynomial-time reduction scheme for MAXIMUM INDEPENDENT Set with 

approximation a(r, a) = ar, for any r G Q, r > 1. 

Proof Let r = j, k,l £ N, k > I > 0. Let G = {V, E) be the input graph. Reducer partitions V 
into k parts Vo,. . . , Vk-i, of size at most [|y|/A;] each. Then it creates k instances. Namely, for any 
z = 0, . . . , A; - 1 it creates Gi = G[U' =o ^(i+i) mod fc]- 

Let SOLq, . . . , SOLfc_i be solutions (independent sets) for Go, • • • , G^-i such that |SOLj| > |0PT(3. I/a. 
Merger simply picks the biggest solution. 

We claim that for some i = 0, . . . , fc - 1, \V{Gi) n OPT| > ||OPT|. Indeed, otherwise all of 
V{Gi) contain less than Z|OPT| copies of elements of OPT, with each element of OPT appearing in 
exactly / copies, hence some elements of OPT do not belong to any V{Gi), a contradiction. Clearly, if 
\V{Gi) n OPT| > f |OPT| then |OPTgJ > i|OPT| = OPT/r. Hence |SOLj| > |OPT|/(ar) and 
the solution returned by merger will be at least that good. □ 

C Coloring 

There is a following simple reduction for VERTEX COLORING. 

Theorem C.l. There is a polynomial-time reduction scheme for VERTEX COLORING with approxima- 
tion a{r, a) = ar,for any r G N, r > 1. 

Proof Let G = (V, E) be the input graph. Reducer partitions V into two r sets Vi,. . . ,Vr, with at most 
[|y|/r] vertices each and returns r instances Gi, . . . ,Gr such that Gi = G[Vi\. 

The input for merger is a coloring Cj : — s- {1, . . . , qr} for each graph Gi such that qi < ax{Gi). 
For any i, Gi C G, so x(.Gi) < x{G) and further qi < ax{G). Merger simply colors each v £ Vi with 
color qj -\- Ci{v). Clearly, it uses at most arx{G) colors, as required. □ 

is the composition: f = fo f-\ f = id. 
''The proof for a maximization problem is analogous 
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A more sophisticated reduction was found by Bjorklund and Husfeldt [2]. Basically, it removes 
maximum independent sets (found by an exact algorithm) until the graph is small enough, and the 
merger just colors the previously removed vertices with new colors (one per each independent set). 
However, taking into account current best time bounds of exact polynomial space algorithms for Max 
Independent Set and Vertex Coloring, this reduction makes sense only when the reduction rate 
r < 4.05 (roughly). This is because for larger rates the total time of the resulting approximation is 
dominated by finding maximum independent sets, so we would get worse approximation guarantee with 
the same total time. A natural idea here is to plug our Max Independent Set approximation into the 
algorithm of Bjorklund and Husfeldt. By modifying their analysis we get the following theorem. 

Theorem C.2. Assume that there is a (i-approximation algorithm for Maximum Independent Set 
with time complexity T{n). Then there is an 0*{T{n))-time reduction scheme for VERTEX COLORING 
with approximation a{r,a) = a + /? In r plus additive error 1, for any r E Q, r > 1. 

Proof Let n = \V{G)\. As long as the number of vertices of G exceeds n/r reducer finds an indepen- 
dent set using the /3-approximation algorithm and removes it from G. Let 7i , . . . , it be the independent 
sets found. Reducer returns the resulting graph G'. 

Now let us upperbound t. Let Gq = G and let Gj be the graph obtained from Gj-i by removing 
Ij. Since any subgraph of G is x(G)-colorable, for any j = 1, . . . , A;, Gj contains an independent set of 
size at least \ V{Gj)\/x{G). It follows that 

\V{Gj)\ <[l- n < e-skn. 

Hence for j > x(G)/?lnr we have \V{Gj)\ < n/r so t < \x{G)p\nr]. 

Let c : V{G') {1, ... ,g} be a coloring of G', q < ax{G'). Since G' is a subgraph of G, 
x{G') < x{G) and hence q < ax{G) colors. Merger returns the following coloring of V{G): ifv^V' 
it has color c{v) and if v e Ij it has color q + j. Clearly, it uses at most ax{G) + t < ax{G) + 
\x{G)P In r] < {a + (3 In r)x(G) + 1 colors. The time complexity of the reduction is 0{nT{n)). □ 

Theorem C.3. Given any O* (2'^"-)-time exact algorithm for Maximum Independent Set, for any 
P > 1, one can construct an 0*{2'^'^ll^)-time reduction scheme for VERTEX COLORING with approxi- 
mation a{r, a) = a + /? In r plus additive error 1, for any r E Q, r > 1. 

Proof The (/3, ^)-reduction from Theorem B.l together with the 0*(2'^")-time exact algorithm gives 
/^-approximation for MAXIMUM INDEPENDENT SET in time 0*(2''"/^). By Thm. C.2 we get the 
claim. □ 

If we have an 0*(2'^")-time exact algorithm for Vertex Coloring, it makes sense to have a 
(a, r)-reduction of time 0*(2'^"/'"). After putting P = cr/d in Theorem C.3 (and keeping /3 > 1) 
we get O* (2^"/'") -time reduction scheme for Vertex COLORING with approximation a(r, a) = a + 
(cr/d) In r plus an additive error 1, for any r e Q, r > d/c. With the currently best known value 
c = 0.288 and d = 1.167 (we consider polynomial space here) it gives a{r,a) = a + 0.247r Inr for 
any r G Q, r > d/c> 4.05. 

Note also that Theorem C.3 impUes that beginning from some value of r, the simple (r, r)-reduction 
from Theorem C.l outperforms the above more sophisticated one. Specifically, for the current values of 
c and d the threshold is r > 58. 

D Reduction for Bandwidth 

In this section we describe a (2, 9a)-reduction for Bandwidth. The following observation will be 

convenient in our proof. Observe that any ordering / : V corresponds to a sequence 

. . . , which will be denoted as s{f). Clearly, bandwidth of / corresponds to maximum 

distance in s(/) between ends of an edge. 
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Theorem D.l. There is a polynomial-time (2, 9a)-reduction for BANDWIDTH. 

Proof. Let G = {V, E) be the input graph. The reducer we are going to describe creates just one 
instance. W.l.o.g. V does not contain isolated vertices for otherwise reducer just removes them and 
merger just adds them in the end of the ordering. We will also assume that bw(G) > 2 - otherwise 
reducer replaces G by the empty graph and merger finds the optimal solution in polynomial (linear) 
time. 

Reducer begins with finding a maximum cardinality matching M in G. Next it defines a function 
p :V ^ V . Note that an unmatched vertex has all neighbors matched. For each unmatched vertex v for 
each of its (matched) neighbors w we put p{w) = w. Consider any uw G M. Assume both p(n) = u 
and p{w) = w. Then u has an unmatched neighbor x and w has an unmatched neighbor y. Observe that 
X = yfoT otherwise M \ {uw} U {xu, wy} is a matching larger than M. In this special case redefine 
p{u) = w. If for some uw G M both p{u) and p{w) are unspecified yet we put p{u) = u and p{w) = u 
(the choice which endpoint is u and which w is arbitrary). Finally, if for some uw G M exactly one 
value of p is specified, say p{u) = u, we put p{w) = u. Now p is fully defined in subdomain V{M). 
Note the following claims. 

Claim 1. For any edge uw G M either p{u) = u and p{w) = uor p{u) = w and p{w) = w. 

Claim 2. For any x ^ V{M), for any its neighbor w, p{w) = w unless there is a triangle uwx with 

uw G M. 

Now reducer specifies the value of p on unmatched vertices, one by one. Let x be an unmatched 
vertex with p{x) unspecified and let w be any of its neighbors. If w has another unmatched neighbor y 
with p{y) unspecified we put p{x) = x and p{y) = x. Otherwise we put p{x) = w. The way we defined 
p impUes the following two claims. 
Claim 3. For at least half of the vertices p{v) / v. 
Claim 4. For any v eV,\p~^{v)\ < 3. 

Finally, reducer simply identifies each pair of vertices u, w (i.e. adds edges wx such that x G 
N[u) \ N[w\ and removes n) such that p{u) = w. Denote the resulting graph G' = {V',E'). Let 
V' CV in the sense that V' = {v e V \ p{v) = v}. By Claim 3 the rate of the reduction is at least 2. 

Before we describe the merger let us bound bw(G'). Let / : F — {1, . . . , \V\} be the ordering of 
V{G) with bandwidth bw(G). 
Claim 5. bw(G') < 3bw(G) - L 

Proof of Claim 5. Let g : V {1, • • • , be the ordering of V which arranges vertices of V in the 
same order as / does, i.e. s{g) which is obtained from s{f) by removing the vertices outside V'. We 
will show that g has bandwidth at most 3bw(G) — 1. Consider any u'v' G E'. Then for some u,v eV, 

p{u) = u', p{v) = v' and uv G E. 

If both f{u) and f{v) are outside the interval (min{/(/9(u)), /(/9(w))}, max{/(p(n)), ))}), 
but at opposite sides of it, then \ f{p{u)) — f{p{v))\ < bw(G). If both f{u) and f{v) are outside this 
interval, but at the same side of it, say at n's side, then since \f{v) — f{p{v))\ < 2b, we have \f{p{u)) — 
fipiv))\ < 2bw(G). In any of these two cases, |/(/9(u)) - fip{v))\ < 2bw(G) < 3bw(G) - 2. It 
follows that p{u) and p{v) are at distance at most 3bw(G) — 2 in s{g), as required. 

Now assume one of f{u) and /(?;), say /(n),is in the interval {mm{f{p{u)), /(p(v))}, max{/(p('u)), f{p{v))}), 
so in particular u ^ V'. Then p{u) and p{v) are in s{g) at distance smaller by at least 1 from their dis- 
tance in s{f ). Hence it suffices to show that \f{p{u)) — f{p{v))\ < 3bw(G). 

First note that if p{u),p{v) V{M) then by Claim lu,v ^ V{M) and then MU{uv} is a matching 
larger than M, a contradiction. Hence w.l.o.g. we can assume that p{u) G V{M). Then p{u) = uor 
p{u) is a neighbor of u. 

Now assume p{v) G V{M). Then also p{v) = v or p{v) is a neighbor of v. It follows that 
\f{p{u)) - f{p{v))\ < \f{p{u)) - f{u)\ + \f{u) - f{v)\ + \f{v) - f{p{v))\ < 3bw(G'). 

Finally, let p{v) ^ V{M). Then v is at distance at most 2 from p{v) and hence \ f{p{v)) — f{v)\ < 
2bw(G). By Claim 2 either p(n) = n or vp{u) G .B so in any case vp(u) G E which implies \f{v) — 
f{p{n))\ < hw{G). Together we get \f{p{u)) - f{p{v))\ < \f{p{v)) - f{v)\ + \f{v) - f{p{u))\ < 
3bw(G). It finishes the proof of Claim 5. 
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Now we describe the merger. Let /' : V {1, . . . , |y|} be the ordering of vertices of V with 
bandwidth at most abw(G') for some a > 1. By Claim 5, bandwidth of / is at most a(3bw(G) — 1) < 

3Qbw(G) - 1. 

Merger returns the ordering / such that s{f) is obtained from s{f') by adding vertices of (^)\{^} 
(there are at most 2 of them by Claim 4) right after v. Clearly s{f) is a permutation of V. Now consider 
any edge uv G E. There are at most 3abw(G) — 2 vertices between p{u) and p{v) in s{f'). It follows 
that there are at most 3(3abw(G) — 2) = 9abw(G) — 6 vertices between p{u) and p{v) in s(/). In 
other words, the distance between p{u) and p{v) in s{f) is at most 9abw(G) — 5. As u is at distance at 
most 2 from p{u) in s{f), and the same holds for v, it follows that the distance between u and v in s{f) 
is at most 9abw(G) — 1. It follows that / has bandwidth at most 9Q;bw(G) — 1. □ 

The above theorem together with Reduction Composition Lemma implies: 

Corollary D.2. There is a polynomial-time reduction scheme for Bandwidth with approximation 
a{r, a) = a9'',for any r = 2^, k ef^. 

For any k, the above reduction gives a 9'^ -approximation in time O*(10"/^'') and polynomial space 
(using the exact algorithm of Feige and Kihan), or in time 0*(5'*/^ ) and 0*(2'*/^ ) space (using the 
exact algorithm of Cygan and PiUpczuk). 

E O* (c'^)-time polynomial space exact algorithms for Set Cover 

Clearly, to make use of universe-scaling reduction we need a 0*(c") exact algorithm, where c is a 
constant. As far as we know there is no such result published. However we can follow the divide-and- 
conquer approach of Gurevich and Shelah [15] rediscovered recently Bjorklund and Husfeldt [1] and we 
get a 0*(4'^m'°s")-time algorithm. If m is big we can use another, 0*(9'*)-time version of it. 

Theorem E.l. There is a O* (min{4"m'°s", 9"})-rime algorithm that finds a minimum-weight cover of 
universe of size n by a family m sets. 

Proof. The algorithm is as follows. For an instance with universe U of size n we recurse on an expo- 
nential number of instances, each with universe of size smaller than n/2. Namely, we choose one of m 
sets S and we divide the remaining elements, i.e. U \ S into two parts, each of size at most n/2. We 
consider all choices of sets and all such partitions - there are 0(m2") of them. For each such set S and 
partition Ui,U2 we find recursively Ci, an optimal cover of Ui and 62, an optimal cover of U2. Clearly 
Ci U 62 U {S} forms a cover of U. We choose the best cover out of the 0*{m2^) covers obtained like 
this. 

Consider an optimal cover OPT. To each element eoiU assign a unique set Se from OPT such 
that e G Se. For each S G OPT lei S* = {e e U : S = Se}. Let y = {S* : S OPT}. ^ is a 
partition of U. Clearly, after removing the biggest set S from OPT we can divide all the sets in 7 into 
two groups, J*! and 7 2, each covering less than n/2 elements from U \S. It follows that one of the 
0*(m2") covers found by the algorithm has weight tt;(OPT), namely the cover obtained for set S and 
partition (U \ ^, U ^2 \ 5). 

It is clear that the above algorithm works in time 0*(4"m'°s"). Similarly we can also get a 0*(9") 
bound - instead of at most m2" instances we recurse on at most 2 • 3" instances: we consider all 
partitions of U into three sets A, B, C. Let > \B\ > |G|. If < n/2 we recurse on A, B and G 
and otherwise we check whether A G § and if so, we recurse on B and G. □ 

F Semi-Metric TSP 

Semi-Metric TSP is a variant of the classical Traveling Salesman Problem. Here we are also 
given n vertices and an edge weight function u; : — >^ R, however now the function w does not need 
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to be symmetric, i.e. for any x, y we may have w{x, y) ^ w{y, x). Thus the instance can be viewed as 
a directed graph, with two oppositely oriented edges joining every pair of vertices. In this variant we 
assume that w satisfies triangle inequality. The goal is to find the lightest (directed) Hamiltonian cycle. 

In contrast to other problems considered in this paper it is not known whether Semi-Metric TSP is 
in APX. The first approximation algorithm for this problem appeared in the work of Frieze, Galbiati and 
Maffioli [14] and it has approximation ratio log2 n. Currently the best result is a | log n-approximation 
due to Feige and Singh [12]. 

The best known exact algorithms are the O* (2") -time exponential space classical algorithm by Held 
and Karp [17] and a 0*(4"n'°s")-tune polynomial space algorithm by Bjorklund and Husfeldt [1]. 

The idea of our reduction is very simple - similarly as in Section 4.1 we run a polynomial-time 
approximation, namely the algorithm by Frieze et al. and stop it the middle. Let us recall the algorithm of 
Frieze et al. It begins with finding a lightest cycle cover Co in G (this can be done in polynomial time by 
finding a minimum weight matching in a corresponding bipartite graph). Note that w{Co) < w{OFTc)- 
If the cycle cover consists of just one cycle we are done. Otherwise the algorithm selects one vertex from 
each cycle. Let Gi be the subgraph of graph G induced by these vertices. Then we find a lightest cycle 
cover in Gi. Note that w{OFTcj^) < w{OPTc), which follows by the triangle inequality. Then again 
w{Gi) < w{OPTg)- Again, if Ci has just one cycle we finish, otherwise we choose a vertex from 
each cycle, build G2 and so on. As the cycles in cycle covers have lengths at least 2, we finish after 
finding at most log n cycle covers. Finally we consider the union of all cycle covers U = \^Gi. Clearly, 
U is Eulerian and we can find an Eulerian cycle E in U. Then we can transform it to a Hamiltonian 
cycle H by following E, but replacing paths with already visited vertices by single edges. We see that 
w{H) < w{E) by triangle inequality and hence uj{H) < Iog2 n • OPT. 

Now, assume r = 2^. If we stop after creating just k cycle covers, we are left with graph Gk with 
< \V{G)\/r, while the cycle covers have weight atmost fc-OPT. If we have an a-approximate 
TSP tour T in Gk, we can add it to the cycle covers and proceed as in the original algorithm. Clearly we 
get a Hamiltonian cycle of weight at most {a + A;) OPT. 

Corollary F.l. There is a polynomial-time reduction scheme for Semi-Metric TSP with approxima- 
tion a{r, a) = a-\- log2 r,for any r = 2^, k E N. 
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